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Abstract—In June of 2016,the Biologic Analog Science 
Associated with Lava Terrains (BASALT) _ research 
project conducted its first field deployment, which we call 
BASALT-1. BASALT-1 consisted of a science-driven field 
campaign in a volcanic field in Idaho as a simulated human 
mission to Mars. Scientists and mission operators were 
provided a suite of ground software tools that we refer to 
collectively as Minerva to carry out their work. Minerva 
provides capabilities for traverse planning and_ route 
optimization, timeline generation and display, procedure 
management, execution monitoring, data archiving, 
visualization, and search. This paper describes the Minerva 
architecture, constituent components, use cases, and some 
preliminary findings from the BASALT-1 campaign. 
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1. INTRODUCTION 


NASA’s flexible architecture for human exploration is 
exemplified by various Design Reference Mission (DRM) 
studies, which outline plans for the exploration of various 
targets including lunar and cis-lunar environments, Near 
Earth Asteroids (NEAs), Phobos & Deimos, and Mars [1-3]. 
Surface science and exploration with humans and robotic 
assets are ubiquitous elements of each of these mission 
scenarios. One challenge for each of these prospective 
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destinations is: How can scientific return be maximized 
given the operational constraints associated with deep space 
exploration? With crew time and resources at a premium, it 
is critically important to develop, test and validate science 
support capabilities and operational concepts to optimize 
human architecture planning and science systems including 
instruments, communications, ground control, and personnel 
organization. 


Terrestrial analog campaigns provide a contextually relevant 
environment in which to test and validate capabilities that 
address these architectural issues. Science-driven analogs, 
such as the BASALT (Biologic Analog Science Associated 
with Lava Terrains) research project, are critically important 
to this process.' The BASALT science program is focused 
on understanding habitability conditions of early and 
present-day Mars in two relevant Mars analog locations (the 
East Rift Zone (ERZ) flow on the Big Island of Hawai’i and 
the eastern Snake River Plain (ESRP) in Idaho). The 
objective is to characterize and compare the physical and 
geochemical conditions of life in these analog environments 
and to learn how to seek, identify, and characterize life and 
life-related chemistry in basaltic environments representing 
two epochs of Martian history. 


Scientific fieldwork is conducted under simulated Mars 
mission constraints, including simulated extravehicular 
activity (EVA) to evaluate selected conops (concepts of 
operations) and capabilities with respect to their anticipated 
value for the joint human and robotic exploration of Mars. 
By conops we mean operational design elements that guide 
the organization and flow of hardware, personnel, 
communications, and data products through the course of a 
mission. By capabilities we mean functionalities that can 
take the form of hardware or software. For a complete 
description of BASALT-1 ConOps, see [15]. Given that our 


' See: https://spacescience.arc.nasa.gov/basalt/ for more BASALT details 


scientific goals are not simulated, there is intrinsic pressure 
on each field deployment to maximize scientific return. This 
requires thoughtful and directed mission planning and 
scheduling, traverse path planning, physical sample 
collection, sample curating, and data assimilation and 
dissemination. The management of these mission elements 
affects both tactical and strategic aspects of our field 
deployments. In addition to our BASALT experience, 
previous analog projects such as the Pavilion Lake Research 
Project (PLRP) [4,5], NASA Extreme Environment Mission 
Operations (NEEMO) [6-8], and Mojave Volatiles 
Prospector (MVP) [9] have further demonstrated the need 
for high-performance capabilities that meet these scientific 
operational mission requirements. 


2. APPROACH 


There are a number of separate capabilities in the 
community for traverse planning, crew scheduling, 
optimization, navigation, communication, decision-making, 
sample documentation, and science team utilization in 
service of scientific mission management requirements [10- 
13]. To date there has not been an integrated suite of 
complementary science operations systems that will provide 
all of these capabilities in a seamless and user-centered 
manner. A key objective of the BASALT project is to 
design, test and deploy such an integrated system while 
evolving its support capabilities to meet human and robotic 
mission requirements specific to deep space and Mars 
scientific exploration. Our integrated capability is referred 
to collectively as Minerva (after the Roman goddess of 
wisdom). 


Minerva brings together existing pieces of software by 
integrating workflows and providing interfaces between 
preexisting tools. Our goal is to make the Minerva suite of 
tools usable and effective, particularly in service of 
managing science operations and enabling science return. 
These constituent components include Playbook, xGDS 
(Exploration Ground Data Systems), and SEXTANT. 


Playbook 


Playbook is a mobile schedule viewer and _ real-time 
execution software aid [13] which has been used at a diverse 
set of analog missions: PLRP, NEEMO, MVP, Desert 
Research and Technologies Studies (D-RATS), Deep Space 
Habitat (DSH), Space Environment Analog for Testing 
EVA Systems and Training (SEATEST), Regolith and 
Environment Science and Oxygen and Lunar Volatile 
Extraction (RESOLVE), and Human Exploration Research 
Analog (HERA). Over three years, we have incrementally 
developed Playbook to better support the various needs of 
Earth analog missions. Over the course of the BASALT 
project, we plan to evaluate existing capabilities and 
subsequently add new capabilities to enable integrated 
science and astronaut teams to conduct Mars-like EVA. 
Playbook also incorporates data transmission delay between 
ground teams and analog Mars Crew team. 
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Figure 1. Playbook timeline, red lines track times 


Playbook has three main functions available to BASALT: 
Timeline viewing (Figure 1), Mission Log text 
communication interface (Figure 2), and the Procedure 
repository. The Procedure repository provides online access 
to procedures, flight rules, and EVA priority documentation. 
The Timeline view shows the scheduled times for all the 
critical mission activities as well as the EVA timeline 
phases for each role: Intravehicular Crew (IV), 
Extravehicular Crew (EV), and Science Team (ST). This 
collaborative view allows the EV/IV crew, Mission Support 
Center (MSC), including ST and other support personnel, to 
share the same dynamic timeline. The Timeline view 
provides aids to help understand the communication latency 
between teams: a solid red line represents current time and 
three dashed red lines represent current time minus one-way 
latency time, current time plus one-way latency time, and 
current time plus round trip latency time. 
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Copy Jun 29 14:03:29. There will not be any extensions beyond 4:30 PET today. The crew will 
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Figure 2. Playbook Mission Log with messages 


Copy Jun 29 13:22:23. See note about unsuitability of CA and CB. EV prefers BB. 


The Mission Log is a chat interface where the MSC and IV 
teams can share text, files, images, and video messages. 
Leveraged significantly when data transmissions are 
delayed, it has become a key capability for teams to 
communicate during the EVA. Within the MSC, the ST 
Lead was tasked with posting messages to the IV crew 
through the Mission Log. These transmissions were 
carefully scripted to efficiently represent the consensus- 
based decisions and guidelines that were to be conveyed to 
the EV/IV crew. Messages included directives regarding 
sampling priorities, scientific queries and requests for 


clarification, among other critical information sharing that 
was focused on improving the scientific quality of the 
EVAs. The IV crew were also able to add further descriptive 
and operational details about the EVA not necessarily 
discernible to the MSC from transmitted voice, video, and 
still images. Each message is time-stamped and has a 
countdown timer to show the sender when to expect their 
message to arrive and the earliest time to receive a response. 


Playbook typically runs on a cloud based architecture and 
uses a completely web based interface. This allows rapid 
deployment for mission analogs where quickly installing or 
setting up software for many users can be challenging. 
Users only need a modern web browser to access Playbook 
for a given mission. For the BASALT analogs, because of 
the remote nature and limited internet connectivity, 
Playbook was deployed on a physical server on site for the 
mission. Because Playbook is primarily client side software 
which relies on a small efficient server process, we are able 
to deploy and support a large number of users (~50+) on 
modest commodity hardware, such as a laptop acting as a 
server. 


xGDS 


Exploration Ground Data Systems (xGDS) is a set of open- 
source, web-based tools including mapping capabilities for 
sharing, authoring, and visualizing map layers; a traverse 
plan editor for planning field activities in a geospatial 
context; displays for real-time visualization of vehicle and 
crew location and activity, system telemetry, and payload 
data; and an integrated data archive for post-hoc analysis, 
browsing, and search. xGDS capabilities have been matured 
by deployment at a variety of NASA analogs prior to 
BASALT, including PLRP, Desert RATS, NEEMO and 
MVP [4,5,9,10]. The BASALT-1 deployment drove the 
design, development, and evaluation of new xGDS 
capabilities specific to supporting human EVA science 
operations and integration with Playbook and SEXTANT. 


xGDS was designed to provide integrated support for 
science operations across all phases of a mission, with 
particular emphasis on pre-mission planning and data 
integration to support rapid science decision making during 
and after operations. xGDS supports the following four 
mission phases: 
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Figure 3. xGDS Traverse Plan edito 


Planning—xGDS uses a-priori map information e.g. remote 
sensing data, known operational hazards or constraints, and 
targets of interest. xGDS enables teams to import, create and 
share map content and collaboratively edit EVA traverse 
plans, as shown in Figure 3. 


P6290074,JPG 
on 


MD10 Sar 


Figure 4. Monitoring crew on EVA; map with tracks on 
left, photo on right 


Monitoring—xGDS ingests live telemetry data from field 
systems (e.g. GPS tracking) and generates maps, raster data 
overlays and 2D plots to visualize payload telemetry and 
EVA or vehicle position in real-time or simulated delay 
mode. It also includes facilities for real-time and post-hoc 
documentation and annotation, as shown in Figure 4. 
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Figure 5. ASD instrument plot view 


Archiving—As xGDS processes field telemetry, it reduces 
data to meaningful and efficient representations and 
organizes it into databases for later analysis, search, 
visualization, and export, as shown in Figure 5. 


Exploring—xGDS provides capabilities to quickly explore 
collected data, see where and when it was collected, and 
search for data products and the correlations between them. 
Real-time semantic labeling greatly facilitates this 


functionality; xGDS users add notes and tags to data 
products and timelines in real-time during operations to 
support future search and analysis. Data search and 
visualization capabilities are used during and between EVA 
operations in a deployment (e.g. to select sampling sites or 
plan a day’s activities) as well as post-deployment to 
support more detailed analysis. 


SEXTANT 


SEXTANT is a resource-based path planning tool that aims 
to optimize human traverses through terrain with elevation 
provided via data elevation models, applying different cost 
functions — traverse length, traverse time or metabolic 
rate[14]. SEXTANT also has the capability to optimize the 
concurrent paths of multiple humans and vehicles [11]. 
Although SEXTANT has previously been deployed in 
hypothetical case studies, BASALT-1 is the first time it has 
been tested in the field. In the context of BASALT, 
SEXTANT can be used to find optimal routes for the EV 
crew, from the EVA starting point through several 
waypoints. 


SEXTANT offers four key functions: first, it establishes a 
guideline path that the IV team can use in order to monitor 
if the EV Crew are walking in the right direction towards 
the intended target. Second it can estimate path traversal 
times, which during mission planning enables the 
calculation of a better estimate on the time available for 
other activities. Third, during mission planning SEXTANT 
can determine whether some of the proposed sample 
locations are reachable or not. Lastly, during the EVA, the 
support personnel can ensure the EV Crew maintain an 
appropriate heading to reach a certain sampling location, 
easing the navigational demand on the EV Crew as they 
walk through the terrain. 


Previous SEXTANT work has focused on the application of 
the tool to hypothetical Lunar EVA traverses; it was built to 
be general enough to apply to any planetary surface 
scenario. The architecture of SEXTANT is composed of 
three components: the terrain model, based on digital 
elevation maps (DEMs), the human or vehicle energy 
consumption model, which incorporates empirical velocity 
and energy consumption models depending on the slope of 
the terrain and gives rise to different cost functions, and a 
solver, which optimizes the cost function across the 
traverse. For BASALT, the terrain DEMs can range from 
one meter resolution based on stereo imagery from satellite 
images to on the order of centimeters resolution collected 
from drone sensors. The cost models are based on astronaut 
EVA suit test data, and as such are not accurate for 
predicting the energy consumption for the unsuited 
BASALT EVA crew because they overestimate energy 
consumption. Since the cost function for unsuited EVA with 
respect to the slope should follow a similar trend (just be of 
a smaller magnitude), optimization with the SEXTANT 
built-in cost functions should lead towards optimal paths for 
the EV Crew. Future work will focus on incorporating 
unsuited crew energy consumption. 


SEXTANT is a numerical tool that produces an optimal 
traverse plan across a given terrain, such as shown in the 
example illustrated in Figure 6. The outputs include the 
planned traverse coordinates and timings. The original 
SEXTANT as developed by Johnson[14] also included a 
graphical user interface where the user could get visual 
feedback on the terrain, and the paths generated, displayed 
on top of a 3D relief map as shown in Figure 7. The 
interface also plotted elevation data and information on 
energy consumption throughout the traverse. For the initial 
incorporation of SEXTANT with xGDS these visualization 
features were eliminated, leaving the basic functionality of 
planning traverses as a black box, and adapting xGDS visual 
features. 


Integration and Work Flow 


Data flow between xGDS and SEXTANT—SEXTANT’s 
Python implementation adheres to a documented API. The 
SEXTANT code is deployed on the xGDS server. Once 
users have created an xGDS Planned Traverse, they click a 
button in the xGDS plan editor to invoke SEXTANT. Users 
pass in constraints to optimize on energy, time or distance, 
control maximum slope and map resolution (or step 
granularity) that SEXTANT will use. The xGDS Planned 
Traverse is passed to SEXTANT in the xGDS xpJson 
format. SEXTANT reads the Planned Traverse’s station 
coordinates out of the xpJson. 


Once SEXTANT has finished processing, it returns Json 
data containing the original stations plus arrays of data 
between the Planned Traverse’s stations. These are 
rendered as line segments in the xGDS plan editor, and the 
updated time estimates are reflected in the xGDS plan 
editor. When the Planned Traverse is exported to Google 
Earth via KML it includes these SEXTANT coordinates. 


When users modify the planned traverse, they can clear and 
recalculate the SEXTANT generated paths. 


Hawaii Volcanoes National Park 


Figure 6. SEXTANT in the xGDS plan editor: waypoints 
are defined by a human planner, yellow lines are 
straight line path, orange lines show SEXTANTS 

optimized path using metabolic energy consumption as 
the cost function. The DEM has 0.5m resolution. 
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Figure 7. Original SEXTANT user interface designed for 
lunar path planning (from [14]) 


Data flow between xGDS and Playbook—Within xGDS for 
each mission day an association is made between a crew 
member and a Planned Traverse, with an expected start 
time. The Planned Traverse can then be manually imported 
into Playbook. This includes the start times and durations 
for all of the waypoints within the Planned Traverse, any 
activities with their start times and durations, along with the 
duration estimates from SEXTANT if any, or straight line 
duration estimates. 


Data flow between instruments, xGDS and science team— 
To support decision making during execution, xGDS 
gathers and displays live data from field systems. For 
BASALT, still images and various IR and XRF spectra are 
key data for science planning and guidance during EVAs. 
Unfortunately, most commercially available analytical 
instruments and cameras have undocumented, proprietary 
interfaces. We were able to overcome this limitation to 
some extent by using a Toshiba FlashAir W03 SD card for 
data storage in our field devices. This card is WiFi capable 
with an onboard scripting engine that supports HTTP data 
transfer and has a documented API. When a device saves a 
file to the SD card, an event is fired that initiates an HTTP 
data transfer to the xGDS server so that new images and 
data are immediately available to the science and operations 
teams. 


3. FIELD TESTING 


The BASALT-1 simulation environment was designed to 
mimic the latest concept of operations proposed by the 
Evolvable Mars Campaign (EMC) and previous NASA 
analog research projects [5,8], see Ref. [15] for more detail 
concerning the operational details and study design. In 
summary, the BASALT-1 field deployment included an EV 
and IV crew comprised of two members each. While the IV 
team was temporally on Mars-time, they were physically 
located at the BASALT team encampment approximately 50 
km away from the field site and the EV team. Specifically , 
the EV team was located within Craters of the Moon 
National Monument and Preserve (Idaho) and tasked with 
conducting science-driven EVAs. Each EVA was designed 


to be ~4 hours in duration and over the course of the 11-day 
field deployment, 10 EVAs were successfully conducted. 
For each EVA, the entire operations team was structured as 
shown in Figure 8 to conduct operations. Figure 8 also 
shows the Minerva users and their respective roles within 
the operations team. There were three main Minerva user 
groups: EV crew, IV crew and ST members. Two EV Crew 
utilized a portable, wrist mounted display to access xGDS 
for GPS tracking and Playbook for mission log messaging. 
Two IV Crew members collectively accessed and interfaced 
with all components of Minerva from console workstations 
that were collocated with the EV (e.g. no time-delay 
between EV/IV communication). The ST (10-15 members) 
utilized all components of Minerva in a distributed manner 
where the different features/capabilities of xGDS were 
delineated to specific roles within the ST, as described in 
Table 1. Situated within the MSC was a large monitor that 
projected video and GPS data for the entire ST team to view 
and track EV crew activities. 
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Figure 8. BASALT-1 field test setup 


The information shared between the operational units varied 
in content and relay direction and represent a fundamental 
change from present-day information flow between MSC 
and flight crew [16,17]. For example, all data from the EV 
crew streamed locally to the IV operators and to the ST 
(accounting for both 5 and 15 minute one-way light time 
delays, depending on the test condition). The IV crew 
conveyed real-time audio/GPS data to the EV crew. The ST 
was only capable of sending audio and text information to 
the IV crew. Previous NASA analog studies have concluded 
that audio communication sent from ST to EV crew over 
time-delayed communication is distracting and has limited 
overall utility. Instead, all ST input was directed to the IV so 
they could synthesize ST input and convey relevant 
data/instruction to the EV crew in a more appropriate (e.g. 
timely and contextually relevant) manner. 


Table 1. Roles and Responsibilities 


Unit Name Responsibilities 
Execute EVA timeline tasks and provide operational 
EVI insight regarding timeline, flight rules/constraints, and 
procedures 
EV 
Execute EVA timeline tasks and provide scientific insight 
EV2 based on scientific expertise (e.g. geologist, geochemist, 


etc.) 


Main interface between CAPCOM and EV1 & 2; guide 
Ivl EV1 & 2 based on EVA timeline, flight rules/constraints, 
and procedures 


Main interface between SCICOM and EV1 & 2; interact 
Iv2 with EV1 & 2 about science tasks, priorities, and 
procedures based on ground ST input 


Flight Responsible for strategic-level EVA decisions related to 
Director _| prioritization of tasks, science, etc.; ensure flight rules are 
/CAPCOM | being followed, coordinates with IV1 


EVA Execute timeline and traverse changes in Minerva during 
Planner |EVAs 


Help ST maintain operational situational awareness 
throughout the EVA (e.g., carefully track EVA timeline 
noting deviations by crew, inform ST when feedback must 
SCICOM | be relayed to crew, etc.) 

Coordinate with ST Lead to relay ST input on science 
tasks, priorities, and procedures to IV crew 

Coordinate with Flight Director on EVA extension requests 


Maintain general science situational awareness throughout 
the EVA to ensure that EVA's science objectives are met; 
lead the ST in providing tactical feedback to the EV/IV 
crew to guide the current EVA; work with SCICOM to 
relay plans/recommendations to the crew 


ST Lead 


MCC/ST 


Analyze science from EV crew compared to precursor 
ST Samples | planned science traverses, interact w/ ST lead on science 
input to provide to IV/EV 


Leaderboard | Maintain accurate record of collective ST input regarding 
Lead sample prioritization 


Focus on incoming information from EV/IV crew (voice, 
video, still imagery, science data) and provide tactical 
input to guide future tasks within the current EVA 


ST Tactical 
Obs. 


Focus on incoming instrument-specific data from EV/IV 
Instrument 1 | crew and provide tactical input to guide future tasks within 
the current EVA 


Focus on incoming instrument-specific data from EV/IV 
Instrument 2 | crew and provide tactical input to guide future tasks within 
the current EVA 


Table 1 shows a brief description of each responsibility 
delegated to each member of the operations team. One main 
research question for BASALT is how to best structure and 
support ST operations to actively influence EVA execution 
across time-delay. That is, how can a team of scientific 
experts download, synthesize, analyze, and generate 
scientific feedback to ensure EVA productivity and mission 
success? A defining characteristic of scientifically driven 
EVA operations is that to truly make progress towards 
scientific objectives involves an iterative scientific thought 
process with typically ill-determined or unpredicted success 
criteria. Contrary to ISS EVA operations where task success 
is clearly defined by hardware configurations and system 
states, the EVAs performed in BASALT require a scientific 


understanding of EV/IV crew activities to ensure successful 
progress is being made toward the overall science 
objectives. For a brief review of the science objectives for 
BASALT-1 see Ref. [15]. As discussed in subsequent 
sections, we experienced various degrees of success 
regarding supporting this science synthesis process using 
Minerva and uncovered additional use-case perspectives. 


The adopted field operations protocol for BASALT-1 was to 
support two main channels of communication, one that 
emphasizes task execution, timeline, and __ flight 
rules/constraints management (Operations) and one that 
focuses on scientific discussion and development (Science). 
As described in Table 1, the IV operators played a critical 
role in the interface between ST input, EV input and their 
own perspectives based on the aggregated data presented to 
them. The IV acted as a relay point of information and input 
from the EV and ST to instruct and guide EV task 
execution. Within the ST, the capsule communication 
(CAPCOM) provided operations relevant input which 
consisted primarily of time management and flight rules 
content. The science communicator (SCICOM) conveyed a 
highly condensed summary of ST survey and sampling 
priorities as well as scientific justification and rationale 
throughout each EVA. 


Table 2. Subset of BASALT-1 use cases with associated 
software capabilities 


Software (Minerva) 


Mission Use Case Description | xGDS | Playbook | Sextant 
Phase 
Create exploration traverse v v 
Pre- 
Mission Create science plan for V V 
station 
Propose change to science V V V 
plan for station 
Modify science plan for V 
station 
Intra- i i i 
Provide science team input V V 


Mission |to crew 


Modify planned traverse v v 


Provide planned traverse V V 
input to crew 


Analyze as-run traverse & V 
science data 


Analyze data during EVA 


to high-grade samples 
Post- 


Mission 


Sample w/ post-processed V 
instrument Inter-EVA 


Analyze sample data after V 
field season 


Use Cases—Early in the development stages of the 
BASALT project, a use case development exercise was 
performed [18,19]. The intent of these activities was to 
articulate what necessary capabilities and functions Minerva 
would need to provide to ensure a successful field 
deployment, similar to efforts in other complex work 
domains such as health care [20], spaceflight operations 
[21,22], and air traffic operations [23]. As shown in Table 2, 
Minerva was expected to provide operational support in all 
facets of the deployment: pre-EVA, intra-EVA, and post- 
EVA. The xGDS and Playbook software packages have had 
extensive use in the field as previously mentioned. The 
challenge for BASALT-1 was to begin integrating each 
tool’s capabilities to ensure adequate capability coverage 
while minimizing duplication of resources. 


Two primary pre-EVA use cases identified were concerned 
with EVA timeline development in the form of a planned 
traverse route and a science plan for each station along the 
route. The ST collected a host of scientific data about the 
field site prior to the deployment to build a contextual 
understanding of what to expect to encounter while in the 
field. This precursor data was used to inform the creation of 
traverse plans and science plans to be executed by the 
EV/IV flight team. The intra-EVA activities Minerva was 
intended to support included modifying the science plan and 
traverse plan and facilitating the synthesis of scientific data 
to be conveyed to the relevant operational members. The 
synthesis of science data included the ability for the ST and 
IV to take notes directly associated with the streaming video 
and still imagery obtained by the EV Crew. The various 
console positions within the ST provided context specific 
notes depending on their expertise with the observed data 
(e.g. the Instrument ST members added instrument-specific 
insight in the form of notes in xGDS). Additionally, xGDS 
enabled the tagging and association of geospatial data to 
sample imagery and video to enable the ST to search and 
filter for specific samples. Playbook provided the ability to 
convey condensed ST input and feedback via the Mission 
Log. Once the EVA was completed, xGDS provided data 
archiving and post-processing support. These use-cases 
were experienced heavily during the field deployment to 
include relevant data that might have been missed during the 
EVA and provide an aggregate dataset to compare to the 
science objectives to inform subsequent planning activities. 


As shown in Table 2, some use cases are supported by 
multiple tools in the Minerva suite. While it may appear 
redundant to have multiple tools support the same use case, 
in practice each tool has specific strengths for the given 
shared use case. For example, for creating and proposing 
changes to a science plan for a station, xGDS supports 
geospatial based planning, Playbook supports activity based 
planning, and SEXTANT assists in human traverse 
planning. While there was some integration between the 
tools for BASALT-1 we hope to further integrate the tools 
for these shared use cases in future BASALT deployments. 


Emergent Use Cases—As is typical with complex 
operations, particularly with envisioned work environments, 
we experienced some emergent use cases that played a 
critical role in the execution of BASALT-1 that had not 
been previously identified. Specifically, we highlight four 
use cases observed among the ST that will be explored in 
future deployments. 


Outside of the Minerva software previously described, the 
ST leveraged a digital leaderboard to help manage the 
tactical preferences and priorities of the samples viewed and 
sampled during each EVA, as shown in Figure 9. Using the 
Google sheets infrastructure, the ST was able to distill the 
detailed notes and scientific data being recorded by xGDS to 
summarize the candidate samples. This capability was 
dynamically changing throughout the EVA as more data 
was obtained by the ST, which then influenced scientist 
preferences and opinions about how the samples 
comparatively ranked against each other. The distributed 
nature of the ST necessitated a console position dedicated to 
the management of the leaderboard so that a consistent 
version existed. Given their close physical proximity to each 
other, the scientists often collectively discussed the state of 
the leaderboard and collectively made alterations to the rank 
order in an evidence based manner by viewing the data 
presented in xGDS. 


Target of 
* Opportunity TO 


Figure 9. An improvised "leaderboard" capability 
was used by the science team to maintain an up-to- 
date list of priorities during each EVA. 


In addition to the leaderboard to manage tactical 
preferences, the ST employed a science data matrix to 
manage strategic data and decisions that directly linked to 
the underlying scientific objectives. Between EVAs, the 
scientist would update the relevant sections of this science 
matrix to help track and maintain awareness of overall 
progress towards each research question. As experienced in 
previous scientific field operations, the detection and 
quantification of scientific research progress is a highly 
iterative process [5,24]. Therefore, quantifying successful 
research progress can be difficult. At first glance, the count 
and type of samples collected provide a quantifiable metric 


by which progress can be measured, but only after detailed 
analysis of those samples can a more complete picture of 
scientific understanding be measured. The level of detail 
and ‘minimum success criteria’ specified in the scientific 
research questions can be somewhat ill-defined, depending 
on the scope and aim of the question, which then influences 
the operational details necessary to plan and include in the 
EVA timeline. 


The BASALT-1 deployment executed 1 EVA per ~24 hours 
which provided time for the ST to preliminarily post- 
process scientific data to influence subsequent EVAs. A 
major use case of the xGDS software was its ability to 
provide archived data to the ST when they were formulating 
their EVA objectives. A general trend observed during the 
deployment was that replanning occurred frequently 
between EVAs, when the scientists had prolonged 
discussions about the collected data, while replanning was 
infrequent during the execution of EVAs. This observation 
was in part due to the standardized study design timeline 
imposed by the operations research objectives. There was 
evidence of confusion in the timeline when reprioritization 
of samples was conveyed, particularly when sent in rapid 
succession from the ST. The EV/IV operate on a separate 
temporal timeline from the ST; by the time the ST 
downloaded, processed and sent feedback, the EV/IV crew 
have moved beyond the content and attention of the content 
to which those feedback messages pertain. In cases where 
multiple prioritization messages were sent, the ST also 
provided justification to help the IV crew understand ST 
rationale. 


A final use case that emerged from the ST during BASALT- 
1 pertained to the distinction between science discussion 
and general operational awareness. Often the ST would 
become immersed in discussion regarding particular aspects 
of samples and lose awareness of what the EV crew were 
doing, necessitating another operator to brief the team when 
people wanted to know what was currently being executed. 
The large video and GPS tracking monitor provided access 
to this detail for all ST members in terms of what the crew 
were visually seeing and doing and where they were. The 
ST also wanted to know if any additional samples had been 
identified and sample specific details. The Playbook 
timeline provided an overall timeline view of the as- 
performed progress of the EV crew, but not sample-specific 
details. While the xGDS tool provided a comprehensive data 
input platform, the ability to quickly synthesize timeline 
progress was difficult to discern, particularly given the 
volume of data xGDS presented in real-time. 


4. RESULTS 


The BASALT-1 field test in Idaho provided an opportunity 
to conduct an initial evaluation of Minerva, focused mainly 
on usability. We currently lack preliminary field-test 
evaluation for SEXTANT (see Lessons Learned), but we 
surveyed all participating team members with regards to the 
usability of Playbook and xGDS. 


Playbook preliminary evaluation—We received positive 
feedback for the real-time Timeline and Mission Log 
capabilities. In particular, team members noted liking EVA 
phase statusing (e.g., knowing which EVA phase was 
happening at that moment) and the additional Mission Log 
messages’ cue for time to delivery and first possible 
response. One BASALT field member noted: “Playbook 
enabled me to better manage my time and attention during 
high intensity periods [of work].” In terms of areas of 
improvement, we identified work processes and capabilities 
that warrant attention. A tighter workflow between ST 
planning with xGDS and Playbook could increase 
efficiencies and minimize miscommunications. With 
regards to Playbook, additional countermeasures or 
capabilities are needed to more effectively communicate 
over periods of high message exchange and long latencies. 
Field team members requested capabilities such as chat 
threads and marking critical or important messages. 


xGDS_ preliminary evaluation—We_ received positive 
feedback on spatial integration of data products, live EVA 
tracking, ease of traverse planning, and centralized storage 
and sharing of data. In terms of areas of improvement, we 
identified requests for more flexibility in user interface 
layout, likely depending on roles and _ responsibilities, 
improvements to real-time data delivery and requests for 
improved or streamlined search and tagging capabilities. 


During BASALT-1, a significant portion of the crew, 
Mission Support and Science teams had limited experience 
using Minerva. Some had previous exposure to xGDS or 
Playbook, but rarely both; SEXTANT is a new capability to 
all team members. As the team becomes more experienced 
and familiar with the toolset, future evaluations will focus 
on the utility of Minerva as an enabler for Mars EVA. 
Specifically, we will look at communication content and 
structure, communication messages relating to the EVA 
timeline, specific capability assessments (as defined by [15] 
as part of larger consensus ratings, and user interaction 
assessments. Additional measures and operational metrics 
are currently being devised and assessed to help quantify the 
evaluation of Minerva. The EVA work domain currently has 
limited standard evaluation methodologies to examine 
operations, therefore as part of the Minerva development 
effort, a concerted effort needs to be made to define what 
measures are relevant and valuable to describe this complex 
operational environment. 


Lessons Learned—Three major lessons were derived from 
BASALT-1 which include: 1) better integration of timeline 
and procedure views from Playbook, 2) enhancing high rate 
of text communication exchanges over time-delay, and 3) 
enhancing traverse path routes. Additional perspectives will 
be explored in subsequent publications. 


Playbook broadcasts timeline changes and status of the 
activities in the Timeline view collaboratively so that the 
whole team sees the same information. During BASALT-1, 
the EVA Planner statused activities as in-progress or 
complete and changed the start time of the activities to 


reflect the as-run plan, but the duration of the activities was 
fixed. During execution, we discovered that the duration of 
an activity highly depends on the maneuverability of terrain 
and samples priorities by the ST, e.g. time to extract 
samples, traverse between samples, etc. When start times 
and durations of activities changed, the visual representation 
of the timeline shifted to overlap activities which wrongly 
conveyed simultaneous task execution. Allowing the status 
and duration of the activities in Playbook to change, to 
better reflect the EVA as it is being executed, will give the 
Mission Support Center an at-a-glance situation awareness 
directly from the timeline. Ideally, the crew would update 
the status of the activities so the ground would receive that 
information after the elapsed time-delay, rather than 
independently updating their own timeline. As_ for 
procedures, the BASALT team creates a vast collection of 
documents, flight rules, and meeting briefs and handovers 
that exist in their own repository, accessed independently 
and distributed via email. Playbook activities can link to 
documents to give users direct access to them, and better 
awareness of the procedures they need to review. 


Because BASALT operates under either 5 or 15-minute 
time-delay communications with the flight crew, the ST 
must often make decisions with incomplete or partial 
information (e.g. video, audio, imagery) to provide EV/IV 
crew with ST preferences. As new information is received, 
updates to the previous science priorities can be generated 
and conveyed to the EV/IV team via the Playbook Mission 
Log. Subsequently, numerous messages can be ‘in-transit’ 
to the EV/IV crew any one point in time, depending on how 
quickly ST input/feedback is generated. This backlog of 
messages causes the messages to arrive in rapid succession 
from the IV perspective, creating a period of heavy 
workload that can cause the crew to miss messages. 
Furthermore, within the exchange of text messages is the 
challenge of confirming that messages were successfully 
received and understood. A method to quickly acknowledge 
message receipt and comprehension could promote a greater 
shared situation awareness among the flight personnel. 
Finally, the content of the messages should dictate a specific 
prioritization within the chat client. For the next BASALT 
deployment, high priority messages will be introduced to 
force messages to remain at the top of the chat client until 
dismissed, to ensure important messages are read. 


Having correct traverse plans that contour obstacles and 
follow less steep inclines ahead of the EVAs provide a 
significant advantage, as incorrect plans can lead to the EV 
crew having to independently reassess and plan their paths 
during a traverse. This was demonstrated when SEXTANT 
had to be replaced with manual path planning due to map 
resolution limitations at 10-15m: the original guiding 
waypoints for the EV crew to get to the sampling locations 
sent the crew through too treacherous and abrupt terrain, 
which they only discovered during the traverse. This lead to 
real-time manual replanning, ultimately requiring extra time 
resources (and in a real EVA environment this would have 
translated to additional use of consumable resources such as 


oxygen). The offset between the guidance waypoints and the 
path taken by the crew is shown in Figure 10. 


Figure 10. Comparison of manually planned EVA route 
(orange) and actual route (green) 


This stands in contrast with the plan developed with high 
resolution data (~3cm). Although the guiding waypoints 
were not generated by SEXTANT, but by the user, Figure 
11 shows how well the GPS tracks stick to the guiding 
waypoints, confirming the quality of the path taken, and 
thus staying on schedule. 


Figure 11. Manually planned waypoints, with high 
resolution(3cm) data elevation map. Green indicate 
flatter areas, red indicates steeper areas. Waypoints in 
red, actual GPS track in bright green. 


In these cases the planning was done manually. SEXTANT 
automates the process, saving significant workload. 
Additionally, SEXTANT is expected to return easier plans 
for the EV crew to traverse, as the energy consumption for 
the crew can be optimized, a feature manual planning does 
not offer. SEXTANT is challenged by the large amount of 
data it needs to parse to find paths through high resolution 
maps, and the lack of ability to generate any useful path 
when relying on low resolution maps. Current work is 
focusing on assessing what middle-ground resolution would 
be optimal for SEXTANT to perform well in abrupt terrain 
such as the Idaho lava flow. 


5. FUTURE WORK 


The BASALT project will have additional field 
deployments, where we will continue to improve on 
Minerva’s capabilities and BASALT workflows. Of 
particular importance is to further integrate the toolsets. We 
have begun doing this with xGDS and SEXTANT, with an 
initial focus on performance optimization and improvements 
to the mechanics of systems integration. In the future, we 
will investigate dynamic user displays of SEXTANT results 
to give planners richer information and greater confidence 
in the routes planned by SEXTANT. We are also building 
additional features into Playbook communication and flight 
following capabilities based on our observations from 
BASALT-1. 


In a previous analog mission, xGDS and Playbook shared 
scheduled activities, where the duration of activities planned 
for sites were imported into Playbook as a timeline. Future 
integrated capabilities will likely include bringing this 
capability to BASALT deployments, and sharing live 
location and activity status in order to provide an EVA 
status board, where ground teams could quickly see what is 
happening at the moment during the EVA in an integrated 
temporal and spatial view of EVA activities. 


Future Playbook functionality also includes highlighting 
high priority Mission Log messages, searching Mission Log 
messages, activities with modifiable durations, and 
improved server connectivity. 
Future xGDS development and assessment will likely 
include: 

¢ Improved real-time data delivery and 
notification for web clients. 
Improved search and semantic tagging tools. 
Continued improvements to human EVA _ specific 
capabilities (vs. robotic assets). 
Working with Playbook and SEXTANT teams on tighter 
integration of capabilities. 
Ongoing assessment with new and experienced users as 
addition capabilities are developed and deployed 


live event 
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